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Abstract 

This study examined the effectiveness of STEAM (Science, Technology, Engineering, Art, 
Mathematics) integrated approach via Scratch on five subconstructs of computational thinking 
(CT) among 29 male and 30 female students. A quasi-experimental design was employed in the 
research. The participants demonstrated the application of CT in designing games via Scratch 
during the intervention. The Computational Thinking Survey (CTS) was administered pre-CT and 
post- CT tests in measuring the five subconstructs of CT. Repeated multivariate analysis of variance 
(MANOVA) results showed that the intervention positively affected male and female students’ 
comprehension concerning the five subconstructs of CT. The results were strengthened by the 
repeated measure of analysis of variance (ANOVA) with posthoc comparisons, indicating all five 
subconstructs of CT increased significantly (p < .05). Indirectly, this research introduced a new 
teaching methodology for students’ CT level in the current electronic and technology-advanced 
era and increased concept manipulation capacity among male and female students. 


Keywords: computational thinking, constructionism theory, five subconstructs of computational 


thinking, Scratch, STEAM integrated approach 


INTRODUCTION 


Science, Technology, Engineering, and Mathematics 
(STEM) education has gained popularity among science 
education with the  interdisciplinary and 
transdisciplinary learning approach (Liliawati et al., 
2018). STEM education emphasizes enhancing science 
and mathematics as an integrated discipline and focuses 
on technology (Liliawati et al., 2018) in solving the 
problem. Nevertheless, many debates and suggestions 
on art integration into STEM have been voiced to 
maximize the STEM impacts in the science educational 


reformation (Bertrand & Namukasa, 2020). The 
educators’ dissatisfaction with the students’ poor 
academic achievement and failure to relate the 


knowledge learned in solving the daily life problems 
under STEM education stimulate the art integration into 
STEM (Bertrand & Namukasa, 2020). 


This prompts the popping out of researches on 
Science, Technology, Engineering, Art and Mathematics 
(STEAM) education in switching educational 
paradigms. The art integration in science learning is by 
communicating the science idea in images, texts, and 
other visual information (Bertrand & Namukasa, 2020), 
especially the abstract concepts. Art (A) is integrated into 
STEM, and it enhances students’ science learning 
through the STEM concepts visualization in the 
viewpoint of the art (Belbase et al., 2021; Jolly, 2014) with 
art experience. 


Through the art experience, students undergo 
aesthetic judgment, attitude, aesthetic understanding, 
aesthetic emotion, and aesthetic value (Hekkert & Leder, 
2007). All the art is aesthetics (Dewey, 1996). The 
aesthetics value of art is the determining factor in 
scientific knowledge progress, and_ revolution 
(McAllister, 1996) as science and art share the common 
aesthetic characteristic and aesthetic theory (Root- 
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Bernstein, 1997). In this context, aesthetics does not only 
serve the purpose on the artistic creation but also the 
process of artistic creation and experience. This pleasing 
aesthetics experience includes meaning satisfaction, 
excitement, self-satisfaction, interesting and even ugly 
values pay the contribution to the aesthetic experience 
(Siizen, 2020). Therefore, the field of aesthetics value of 
art in STEAM research is focused not only on the art but 
also on how students communicate on artwork and 
perceive the artwork during the STEAM integrated 
approach intervention. 


Hence, there is no controversy between STEAM 
learning and STEM learning but instead enhancing and 
enlarging the STEM education scope. The STEAM 
authorises teachers to conduct project-based learning 
across every five disciplines and encourage an engaging 
and interactive aesthetics learning environment 
(Liliawati et al., 2018). The design is abstract, but through 
the art, the learning process is visualised with seeing and 
feeling in the socialisation process, to find solutions to 
the problems faced. Aesthetics of art contributes to the 
personal physical, mental and social development 
(Siizen, 2020). This creates robust solutions and products 
by designing meaningful interdisciplinary aesthetics 
projects that close the gap between disciplines. In design, 
creating pleasing aesthetics in a product leads to better 
usability and user experience, and aesthetic value 
(Hekkert & Leder, 2007). Hence, the aesthetic experience 
plays a vital role in scientists and in doing science and to 
well-functioning science in class. So, in this research, the 
electricity concepts’ abstract concepts can be 
contextualised and visualised with the A (art) in the 
STEAM, which incorporates multiple disciplines 
simultaneously. The role of aesthetics value of art is 
essential as a tool for scientific inquiry and abstract 
reasoning in the context of science education (Hammer, 
2014) is undeniable. 


Even though STEM education incorporates multiple 
disciplines to promote learning experiences, STEM skills 
seem insufficient in nurturing other problem-solving 
skills that enable students to explore, experiment, study, 
discover and practice innovative problem-solving skills 
(Belbase et al., 2021). Under the STEAM framework, 
students are exposed to the subject matter knowledge 
and skills in solving-problem by knowing the interactive 
method to learn, think critically, creativity, ask 
questions, discover, and create possible solutions 
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(Belbase et al., 2021). In short, the principal concept of 
STEAM education is to promote aesthetic experience 
arts-based learning to discover new skills and 
approaches in cultivating creative and collaborative 
problem-solving skills (Belbase et al., 2021). Hence, this 
research’s primary purpose was to understand better the 
aesthetics value of art in the STEAM integrated approach 
and the potential of art in STEAM in enhancing 
electricity concepts comprehension level among 
students by nurturing the CT skills. This research has 
implications for designing the practical teaching- 
learning tasks in STEAM programs and how students 
solve learning difficulties with CT by implemented the 
STEAM integrated approach method with applied 
Science, Technology, Engineering, Art, and Mathematics 
element. 


In this research, the STEAM integrated approach via 
Scratch comparatively taught both gender of students 
and beyond discipline character-building five 
subconstruct of CT skills. The five subconstruct CT skills 
taught included: algorithmic thinking, cooperativity, 
creativity, critical thinking, and problem-solving skill. 
The researcher uses the electricity games design 
activities to identify whether there is a change in the 
ability to apply the five subconstruct CT skills in each 
learning process before and after learning. The electricity 
games designed provided a scientific and art experience 
for students to carry out a series of algorithmic thinking, 
cooperativity, creativity, critical thinking, and problem- 
solving skills to produce innovative games in learning. 
This STEAM integrated approach learning environment 
provides multiple entry points, multiple ways to 
approach a_ problem, and multiple aesthetics 
representations in the game were designing on 
electricity concepts activities with the CT. Meanwhile, 
STEAM learning emphasizes the involvement of 
students in constructing their own aesthetics science 
learning. Spyropoulou et al. (2020) acknowledged that 
STEAM learning makes students appreciate the 
implication of art and science in many forms of critical 
thinking skills, creativity, and imagination when they try 
to understand real problems during a games 
development. STEAM learning activities can be 
achieved by observation and experimentation through 
games development based on the electricity concept. 


The theme of electricity was chosen because it 
combined some essential competencies into an exciting 


theme that can make time more effective and can 
facilitate students in understanding material or concepts. 
In addition, electricity is an essential component of our 
lives. Therefore, with the theme of electricity, students 
can understand the meaning of current, voltage, and 
resistance, the different types of electric circuits, and the 
calculation of the current, voltage, and resistance in a 
different circuit in an innovative way STEAM integrated 
approach. By studying the theme of electricity, students 
can realise the concept of science that exists in the 
everyday phenomenon, making it easier for students to 
learn with the art integration. 


In contrast to other research on STEAM, this research 
identifies the CT skills and the competency in applying 
CT skills across the STEAM disciplines. Also, the 
research stresses the enduring aesthetics value of the art 
element in STEAM integrated approach engagement 
with different genders of students, which has the 
potential to impact change in learning electricity 
concepts and solving problems with art and science such 
as in STEAM. However, empirical research on STEAM 
education is in its infancy, and little research has 
compared the capability of male and female students to 
develop CT skills through art integration in STEAM 
education. The research compares the aesthetic 
experience through games designed by male and female 
students and focuses mainly on the CT application 
across the STEAM disciplines in designing the game 
with an electricity theme. 


Research Problem 


CT is fundamental in analytical thinking (Bati, 2018) 
when focusing on solving problems, designing systems, 
and understanding human behaviour (Curzon et al., 
2009; Wing, 2006). However, the application of CT is 
often confined and applied to activities in programming 
design and computer science (Hsu et al., 2018). Even 
though programming is commonly used as important 
activities in developing students’ CT, some researchers 
have pointed out that students focused more in learning 
programming language than problem solving with CT 
(Buitrago Florez et al., 2017; Li et al., 2020). In this case, 
Qin (2009) proved that CT provides a vital skill set in 
modern sciences (Qin, 2009). In fact, as Denning (2009, 
2017) pointed out, CT has long been used in many 
professional fields likes physics and biology besides 
computer science. For example, problem solving and 
model building in biology research (Brodland, 2015) and 
climate management (Garner et al., 2016). 


Previous research finding proved that abstract 
concepts in science delay the students’ improvement in 
learning because no proper and correct methods or 
guidance were available for students to deal wtih the 
theoretical concepts in education and solve the difficult 
questions (Anderman et al., 2012). Moreover, students 
find utilising human creativity and critical thinking 
challenging to enhance social problem-solving 
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(Anderman et al., 2012). On the other hand, Gal-Ezer and 
Zur (2004) acknowledged that nurturing CT is not easy 
since CT was not included in primary and secondary 
school curricula. CT is only used in teaching data 
structures and university programming courses. 


Besides that, many teachers faced the difficulties in 
developing and designing particular educational 
activities for teaching CT to students (Hsu et al. 2018; Li 
et al., 2020) due to the reason the complexity of the 
multiple nature of CT, but also to the wide range of 
different interventions and educational programs (Shute 
et al., 2017). Besides that, integrating CT in 
interdisciplinary education of STEAM is a new topic (Li 
et al., 2020; Li, 2018). Some researchers proposed 
alternative methods to develop problem-solving with 
CT such as, “systematic CT” (Michaelson, 2018) and 
“creative computational problem solving” (Chevalier et 
al., 2020). However, the significance of CT in STEAM 
fields did not automatically translate into school 
instruction (Li et al., 2020). 


STEAM education has gained recognition as an 
educational movement in different parts of the world 
(Liao, 2016). Although STEAM education has been 
increasingly emphasised in schools, most STEAM 
studies focused on computer science and computing 
programming. Problem-solving skills among students 
are challenging to be developed when learning science 
in STEAM studies. Most STEAM education studies 
utilise the model as the context-based learning approach 
(Metz, 2007; Papanikolaou, 2010; Yakman, 2008) and the 
importance of the STEAM education system (Conde et 
al., 2019). Only a smaller number of STEAM researchers 
developed skills in solving science learning lessons 
(Metz, 2007). Integrating the STEAM approach in the 
present educational background is complicated (Conde 
et al., 2019). Concentrating on a single subject and 
combining all the five disciplines into one item without 
losing the initial quality and learning objectives is 
challenging (Conde et al., 2019). The unsuitable teaching 
method caused confusion and misconception for the 
scientific concepts and consequently deteriorated the 
enthusiasm in learning (Dolgopolovas & Dagiene, 2021). 


Similarly, integrating science and art or engineering 
into other subjects is tough as there is no similarity in 
learning objectives (Conde et al., 2019). Experts in the 
field might support the difficulty of integrating, but a 
new problem might be created as only qualified teachers 
can teach painting and music, while engineering experts 
are not employed as teachers in schools (Conde et al., 
2019). The more critical part is identifying the most 
critical contents to be followed and steps to be pursued 
by science educators to adopt a practical STEAM 
approach. Besides that, gender effect on the application 
of a practical STEAM approach also being one of the 
consideration of determining the effectiveness of 
STEAM integrated approach. Meinck and Brese (2019) as 
well as (Gatan et al., 2021) claimed that gender effect do 
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exist due to the education policy and teaching method 
implication. It is supported by Cimpian et al. (2020) by 
acknowledging that gender inequality is getting obvious 
as the workforce is becoming male dominated. The 
alarming gender disparity have been identified in the 
2015 United Nations General Assembly and recognizes 
that females’ important role in th society (United 
Nations, 2015). UNESCO (2017) acknowledged that 
females played the vital contribution as the problem 
solver on the nowadays problems besides males. Hence, 
in solving the gender disparity, Iglesias et al. (2018) 
claimed that STEAM influenced gender equality in 
STEAM classrooms. Metz (2007) also agreed with the 
potential of STEAM education in reducing the gender 
Sap. 

Moreover, there was hardly any research of the 
aesthetic sides of science in science education, and often 
aesthetics is pictured in other subjects rather than science 
(Wickman, 2006). Only a small number of research based 
on the aesthetic experience that comprises the aesthetic 
objectively, as a universal phenomenon, was carried out 
(Van Maanen, 2009). Hence, it is undeniable that the 
aesthetic sides of science have been greatly neglected in 
science educational studies. Most students have the 
concept of science as the reproduction of history or a 
solipsistic individual construction (Wickman, 2006). This 
caused the knowledge regarding aesthetics’ contribution 
to science education has not advanced much (Hammer, 
2014). Hence, the role of these aesthetic experiences in 
doing science in class through the art element in the 
STEAM integrated approach was studied here to order 
to find out that the aesthetic experiences are not only 
simply a motivational driving mechanism nor making 
students evaluate science by making it more fun. This 
study determined the function of aesthetics in science in 
cognitive relevance for understanding science or judging 
what counts and does not count in science. That was the 
reason this research adopted a practical STEAM 
integrated approach by employing Scratch to enhance 
the CT level and raising awareness of persisting inequity 
gender issues. Based on these concerns, this research 
aimed to address the gap mentioned above in the 
research. 


THEORETICAL FRAMEWORK 


A STEAM integrated approach using Scratch was 
applied in this research, encompassing new integrating 
teaching and learning science approaches to enhance 
CT’s five subconstructs, namely algorithmic thinking, 
cooperation, creativity, critical thinking, and problem- 
solving. 


It is STEAM and Not STEM 


Science, Technology, Engineering, and Mathematics 
(STEM) education gained popularity in the United States 
and Europe in the 21st century (Bati et al., 2018), while 


4/19 


STEAM education was widely promoted in South Korea 
(Kang, 2019; Park et al., 2016). Although the STEAM 
education movement was implemented concurrently 
with STEM (Kang, 2019), the educational achievement 
results differed. Under the STEAM education, South 
Korean students had shown significantly outstanding 
successes in international student evaluation, likes the 
Programme for International Student Assessment (PISA) 
and the Trends in International Mathematics and Science 
Study (TIMSS) (Park et al., 2016). STEAM is implicated 
as an advanced version of STEM and as the knowledge 
and skills supplier for context-specific projects and 
problem-based education approaches (Dolgopolovas & 
Dagiené, 2021). 

Both STEM and STEAM education encompasses the 
disciplines of science, technology, engineering, and 
mathematics in an integrated manner (Tunc & Bagceci, 
2021) while educating students to design solutions in 
solving real-world problems. In comparison, STEM and 
STEAM education might overlap on _ specific 
methodology; however, STEAM introduces the concept 
of artistic discipline (Kang, 2019), fostering creativity, 
global awareness, design, and literature (Baek et al., 
2012). Hence, while STEM education is more technology 
focus, and artistic principles bind STEAM education 
with a technology-based curriculum. To make that 
happen, STEAM infused artistic disciplines into STEM 
instruction. Arts modalities are used to interpret, 
present, and share STEM work, and the arts are a helpful 
assessment tool for STEM learning (Kelly & Knowlws, 
2016). 


Artistic values are rarely focused in STEM education, 
even when preparing the scientific-artistic collaboration 
syllabus (Kang, 2019). In the STEM program, it is rarely 
seen that students could make connections between 
science and artistic design principal and even in the idea 
of applied science (Segarra et al., 2018). The additional 
artistic component into STEM education (Kang, 2019) 
meets the challenges of preparing a quality literate, 
creative, and well-rounded workforce while fulfilling a 
highly technology-based society (Baek et al., 2012; 
Bahrum et al., 2017). So, the artistic component under 
STEAM education should be seen as a mutual 
component rather than teaching aids. With art 
integration in STEM, students gain broader access to 
scientific concept learning, build technical skills hidden 
in the curriculum, and enhance students’ mastery of 
design and cross-disciplinary collaboration (Segarra et 
al., 2018). Successful integration of art into STEM was 
displayed by several meta-analyses as_ students’ 
experiences in STEAM education display improved 
cognitive and affective learning (Kang, 2019). 
Nevertheless, the effect is more substantial in affective 
domains. 

From the aspect of the application, STEM and 
STEAM education have also seen the differences. 
STEAM education strengthens STEM _ education 


(Bahrum et al., 2017; Dolgopolovas & Dagiené, 2021), 
whereby the identified differences are the extra 
characteristics found in STEAM education and not in 
STEM. Firstly, STEM education demonstrates the 
understanding of science and mathematics standards 
being taught in the classroom, whereas STEAM 
education uses the arts to demonstrate understanding of 
science and mathematics standards being taught in the 
classroom (Moore et al., 2014). Secondly, in explaining 
the characteristic of STEM, STEM uses the knowledge of 
Mathematics and _ science knowledge to create 
technologies using an engineering approach, whereas 
STEAM education is interpreted through engineering 
and the arts, all based on Mathematical elements (Kelly 
& Knowlws, 2016). In analytical thinking, Land (2013), 
and Tunc and Bagceci (2021) claimed that the traditional 
STEM approach is developing analytical thinking skills, 
but both analytical and creative thinking skills come to 
the forepart in STEAM education approach. Students 
analyse and diagnose science and mathematics 
questions and use algorithmic thinking to narrate the 
problem briefly. According to Weintrop et al. (2016), 
STEAM classrooms provide computational tools and 
practices to students and prepare them with a more 
realistic view of these fields. 


Both STEM and STEAM education reflects real-life 
application and problem-solving skills. Nevertheless, 
the literature review by Papanikolaou (2010), and Yamak 
et al. (2014) shows that most STEM education practices 
are focused on technology development in the context- 
based learning approach and confined to software and 
robot construction, rather than solving real-life 
problems. Yet, STEAM allows developing STEM skills to 
frame the STEM projects in a more practical, real-world 
setting so that students can develop STEM skills and be 
applicable and integrated with the need of the natural 
world simultaneously (Brophy et al., 2008). Regardless 
of STEM embraces the 4C (creativity, collaboration, 
critical thinking, and communication), analysis, 
teamwork, and STEAM embrace the same component as 
STEM, but all are deeply rooted in the arts. Art 
introduces a new level of creativity, new ways to 
innovate and create, communicate complex information, 
sparking students’ imagination, demonstrate new and 
exciting ways of thinking and problem-solving. 


STEAM advocates argue that STEAM exploring 
where art naturally fits into the STEM subjects in STEAM 
education (Jolly, 2014; Kelly & Knowlws, 2016; Moore et 
al., 2014; Oner et al., 2016). Adding some STEAM into 
STEM by applying design and computer graphics to 
projects or using the performing art to communicate a 
STEM project provides the tools to various learning 
styles. (Jolly, 2014; Kelly & Knowlws, 2016; Moore et al., 
2014; Oner et al., 2016). Hence, adding art to STEM does 
not take anything away from education. STEAM is 
applying creative thinking to STEM projects, enhancing 
students’ imagination and creativity through arts. 
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STEAM education helps to improve, enhance and retain 
the skills and facts learned (Bahrum et al., 2017). 


Conversely, some STEM advocates argue that art 
integration dilutes the STEM lesson as time on the core 
four subjects are minor (Kelly & Knowlws, 2016; Moore 
et al., 2014). The STEM advocates also argue that enough 
creative thinking in Science and Engineering. So, it does 
not need to add another creative aspect to create the 
tomorrow thinker. In summary, STEAM provides a 
primary method for non-scientist citizens to engage with 
scientific ideas, questions, and narratives. Thus, they 
increase scientific literacy, awareness, potential action 
and have a more positive perception of STEAM-worthy 
goals for the scientific community. Therefore, the 
STEAM integrated approach was applied rather than 
STEM in this research. 


Aesthetics Value in Art 


Aesthetics is the branch of philosophy related to a 
sensory value (Stizen, 2020). Aesthetics means beauty or 
the beauty of the subject. In other words, aesthetics can 
be explained with sensory information directed towards 
beauty. In daily lives, aesthetics’ is used to describe the 
sensitivity and style of a work of art (Stizen, 2020). The 
significance of sensory information and_ sensory 
perception through art has been revealed in the science 
or teaching of the beautiful and pleasing experience. 
Thus, those aesthetics researches were focused not on the 
art but the process of art creation (Stizen, 2020). Pleasure 
is an essential aesthetic experience to explore the 
understanding and _ solution underlying _ the 
phenomenon (Siizen, 2020). Aesthetic minds enable 
students to think, identify, define and explain concepts 
through a simple aesthetic idea across disciplines 
(Siizen, 2020) which contributes to forming profound 
perceptions and pleasant experiences in science learning, 
especially the abstract concepts. Hence, the contribution 
of the interaction of different disciplines in STEAM to 
students’ artistic activities and art views was ensured in 
this research via the achievement in electricity concept 
and CT. 


Computational Thinking 


CT provides a better solution in academic or real-life 
situations (Park et al., 2015). Reality, there are lots of 
definitions on CT by the researcher (Bati et al., 2018; 
Curzon et al., 2009; Korkmaz et al., 2017; Park et al., 
2015). Among all the definitions, CT is defined as the 
fundamental to compare and analyze several algorithms 
and solve a problem creatively with critical thinking 
(Gal-Ezer & Zur, 2004). The CT combines logical, 
arithmetical, efficient, scientific, and innovative thinking 
and other thinking qualities, such as creativity and 
intuition (Curzon et al., 2009) in solving problems. The 
International Society for Technology in Education (ISTE) 
(2015) asserted that creativity, algorithmic thinking, 
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critical thinking, problem-solving, communication, and 
cooperation as the workable solution to the students’ 
problems were found under CT. Besides that, 
Henderson et al. (2007) also added that CT represented 
reasoning, the way people solve problems, both as 
humans and a computer, rather than thinking like a 
computer (Bati et al., 2018). CT can be utilized in 
generalizing and transferring the problem-solving 
process to a wide variety of problems in other disciplines 
or subjects (Curzon, 2015; Qin, 2009) besides computer 
science and programming. 


So, among all the definitions found in defining the 
problems solving skills under the CT and_ the 
subconstructs CT-related skills (Korkmaz et al., 2017; 
Park et al., 2015), Korkmaz et al. (2017) had identified 
five subconstructs of CT, namely algorithmic thinking, 
cooperativity, creativity, critical thinking, and problem- 
solving. Even Doleck et al. (2017) also supported that CT 
can be best understood as an umbrella for algorithmic 
thinking, collaboration, creativity, critical thinking, and 
problem-solving. Therefore, the STEAM integrated 
approach via Scratch was used to enhance problem- 
solving skills with CT in this research, and yet it is vital 
in educating new generations of students in the twenty- 
first century. Indirectly, the high capability to solve 
problems attributes a high locus of control personality in 
students’ lives, whereby students have high confidence 
in handling and solving power (Ergiin & Kiilekci, 2019; 
Gatan et al., 2021). 


STEAM Integrated Approach into Science Learning 


The STEAM integrated approach integrates as a 
transdisciplinary epistemology. The STEAM disciplines 
via the aesthetics activities via Scratch were used in this 
research to enhance the five CT subconstructs identified 
by Korkmaz et al. (2017), namely algorithmic thinking, 
cooperativity, creativity, critical thinking, and problem- 
solving skills among students. A_ transdisciplinary 
potential in STEAM integrated approach allows the five 
disciplines to be taught based on one topic with 
spontaneous cross-curricular elements to be examined 
(Yakman, 2008). Students apply knowledge and 
practices across five different disciplines in STEAM 
(Kelley & Knowles, 2016) to experience deep learning 
when problem-solving and computational skills are 
applied concurrently with understanding (Bati et al., 
2018). 


In this research, the STEAM integrated approach via 
Scratch was referred to as teaching science where arts, 
technology, mathematics, and engineering provide 
methods and contexts for learning the science. The 
aesthetics value of the art, namely artistic object, shape, 
color, sound, and movement of designed characters in 
the Scratch, provides the sensory and_ perceptual 
experience manipulation in students’ minds and 
perception. Besides that, the aesthetics experiences 
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include excitement, interest, eagerly in the process of 
artistic creation. In this context, the aesthetics experience 
in the STEAM integrated approach was focused on the 
art and the application of CT in the artwork creation 
process. 


The samples in this research were required to design 
the electricity concept games based on the STEAM 
integrated approach, whereby the samples have been 
exposed to the opportunity to apply and enhance CT 
skills. The artwork in the game design made the research 
unique as aesthetic representations of scientific 
knowledge were used to understand the science 
concepts. The aesthetics value of art in STEAM facilitates 
students’ scientific participation or discovery in 
aesthetics experience. As the art platform, Scratch was 
used to develop own aesthetic understanding from the 
design work based on the constructionism theory that 
parallels with Kalelioglu and Giilbahar’s (2014) study in 
using Scratch as the learning tool. The integration of art 
and the aesthetics framework in the art could be 
implemented either interdisciplinary or 
transdisciplinary framework (Hammer, 1996; Tan et al., 
2020). 


From the perspectives of arts and the sciences, the 
designed games represented a unique quantum of 
interpretation that made sense of external abstract 
signals (Tan et al., 2020). Applying art into the science 
lessons posed the same working method of scientists and 
artists in solving the problems. Scientists and artists 
apply observation, inspection, and reflection to analyze 
abstract environmental signals (Quigley & Herro, 2016). 
Students experience the different perspectives of 
aesthetic experience in doing the aesthetic 
understanding, aesthetic analysis, and aesthetic learning 
through visualization. Thus, the applied STEAM 
integrated approach in this research emphasizes the 
aesthetic art experience in enhancing the science 
concepts learning, especially electricity concepts, and 
enhancing CT. 


Students observe, inspect, reflect, and play during the 
game designing. Students visualize abstract concepts 
like voltage, current, and resistance in electricity 
concepts through the art. By reflecting on students’ 
practice of designing games, students enhanced and 
gained their understanding by using the aesthetic tool to 
abstract reasoning and critical thinking (Hammer, 1996) 
in learning the electricity concept. The designed games 
were unique in their aesthetics presentation as the 
design combined works of art, formulas, electricity 
theories, or diagrams, but all of them have similarities in 
which those designing processes communicated abstract 
ideas in electricity content. It was parallel with Tan et al. 
(2020), and Hammer (1996), who incorporated art and 
aesthetics in the STEAM laboratories to enhance science 
education in an aesthetic framework. 


Designing activities provide a context for STEAM 
integration. The art is found to be more accessible 
electricity concepts learning and facilitate the mastering 
of the science idea in a meaningful and more manageable 
way (Tan et al., 2020). With the art integration in the 
electricity concepts lessons, students should grasp the 
bonding and interrelation of every component in 
electricity with art and reduce the learning issue. 
Applying art in an actual situation should direct 
students to the deeper learning (Tan et al., 2020) of the 
electricity concepts as the students are exposed to the 
opportunity to communicate content knowledge and 
information artistically. Therefore, games designing 
required creating and forming own understanding and 
making connections, especially the abstract nature of 
electricity concepts and reasoning required in electricity 
concepts learning (Gibbons et al., 2003; Tan et al., 2020) 
that is parallel with the constructionism theory. In games 
designing, the students’ primary purpose was on the art 
usage in delivering electricity concepts to enhance their 
CT skills. The game designing project focused on the 
way students infused the art element with engineering 
and technology artistically in designing games. Students 
were needed to apply science and mathematics concepts 
to compute and modify the spirits steps (the character in 
Scratch) in the STEAM integrated approach via Scratch, 
whereby the CT skills were applied. 


Visual, spatial, and graphic art can foster 
understanding of science concepts (Segarra et al., 2018), 
especially electricity concepts. Besides, Segarra et al. 
(2018) also agreed that visual art was the most prominent 
and popular art form when integrating art into STEM 
was proposed. Drawing served as a model for problem- 
solving with visual art by close observations to invoke a 
connection between function and form (Segarra et al., 
2018). Segarra et al. (2018) showed that incorporating 
drawing activities into STEM learning helped students 
learn straightforwardly and thoroughly. The students 
reflect on their scientific experience and comprehension 
through drawing and painting (Segarra et al., 2018). 
Drawing fosters close observation, helps create 
relationships between function and form, and serves as 
a problem-solving model (Segarra et al., 2018). Learning, 
applying, and applying science and mathematics 
concepts occur as students work in teams to find 
solutions for real-world problems (Kang, 2019; Kelley & 
Knowles, 2016). 


McGrath and Brown (2005) strongly agreed with the 
potential of visual art in improving cognition in ‘STEM’ 
education. At the same time, the main findings by 
Henriksen (2014) also proved that art integration into 
STEM emerges to promote more motivation, 
participation, and concept-changing influence on the 
existing STEM-based learning. These studies described 
the strengthening and improvement of STEM discipline 
by integrating the art, making the study more holistic 
when using the right brain divergent thinking and left- 
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brain convergent thinking (Bahrum et al., 2017). In 
addition to improving the core content, arts integration 
can be engaging and be the moment of pleasure and 
appreciation, of fun to learning (Bahrum et al., 2017; 
Segarra et al., 2018). It resulted in students under the 
STEAM education appearing to be more creative, have 
critical thinking, and work in teamwork, communicate, 
and solve problems in designing and implementing 
activities (Bahrum et al., 2017). Moreover, art integration 
into the STEM disciplines poses a high potential in 
promoting rigor and creativity while enabling multiple 
neural pathways with a higher probability of retaining 
knowledge (Bahrum et al., 2017; Land, 2013). Long-term 
results in retaining knowledge are achieved (Kang, 2019) 
as the visual arts activities promise enjoyable scientific 
experiences through scientific concepts’ artistic creations 
(Segarra et al., 2018). 


A real STEAM education also enhances students’ 
understanding of applying science concepts and 
improving technologies and engineering (Psycharis, 
2018). Engineering and technology in STEAM are 
simultaneously essential in preparing students to face 
challenges. According to the National Research Council 
(2012a, 2012b), engineering practices at the school level 
involve clarifying problems, designing and _ using 
models, planning and carrying out investigations, 
analyzing data, using mathematics and CT, developing 
solutions, working in argument from evidence as well as 
obtaining, assessing, and analyzing information. The 
involvement of engineering and technology is due to the 
potential of engineering in nurturing creativity and 
logic-based mathematics and science (Yakman, 2008). 


Hence, the application of engineering and technology 
in STEAM integrated approach in this research help in 
utilizing new knowledge innovatively in problem- 
solving that reflects what students learned and the 
effectiveness of the strategies employed in solving a 
problem. Moreover, engineering and _ technology 
involved in creating technology cause permanent 
changes to science, the natural elements that make up the 
universe (Yakman, 2008). The designing process 
incorporates intelligence, mind, and understanding 
human behaviour into scientific thinking (Wing, 2011). 
These STEAM integrated approach practices exposed 
students to the opportunities to solve engineering 
problems or challenges. Hence, the games designing 
process requires knowledge in art with the help of 
engineering and technology. In summary, science 
concepts can be learned with art, mathematics functions 
as the solving method, while engineering and 
technology work as the solving tool in learning in this 
STEAM integrated approach in the research. 


AIM AND RESEARCH QUESTIONS 


This research explored the effectiveness of using the 
STEAM integrated approach via Scratch to educate male 
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and female students on the electricity concept to enhance 
CT skills. The following research questions were used to 
guide this study: 


1. What are the mean score achievement of male and 
female students in CT, algorithmic thinking, 
cooperativity, creativity, critical thinking, and 
problem-solving skill? 


2. Do differences exist in male and female students 
achievement in CT, algorithmic thinking, 
cooperativity, creativity, critical thinking, and 
problem-solving skill? 


METHODOLOGY 


General Background 


A quasi-experimental design consisted of male and 
female groups was used in this research to study the 
effect of the STEAM integrated approach at the CT level. 
The CT subconstructs consisted of algorithmic thinking, 
cooperativity, creativity, critical thinking, and problem- 
solving skill after the intervention. The STEAM 
integrated approach via Scratch was used to conduct the 
lessons on electricity. The science application is applied 
when explaining the concepts of electricity. Technology 
application is made when students apply a technology 
product using Scratch to design games on electricity. 
Engineering application is made when the students 
design the games on electricity which evaluate the 
comprehension and the mastering the electricity 
concepts. Implementation of art is used to designing and 
explaining the electricity concepts by including elements 
such as writing, drawing, and conversation in Scratch. 
The mathematics application is applied to measure the 
movement of the characters in Scratch. 


A pre-test was carried out before the intervention was 
conducted on both groups to identify the students’ initial 
CT levels. Two months of intervention were given after 
the pre-test. The students were required to design games 
based on the electricity topic during the intervention, 
whereby the CT was evaluated throughout the design. 
The students have to show the ability to construct 
various question types to solve the game problems, work 
collaboratively, use creative thinking strategies in game- 
making and solve challenges besides the game designing 
process. Indirectly, the constructionist theory was 
applied when the students started investigating, 
creating, and solving problems. The students played the 
role of mathematicians and scientists when exploring 
and interacting with the virtual world through 
mathematics and _ science systems during game 
designing (Groff et al., 2010). Last but not least, the 
students must have the ability to act on constructional 
feedback with critical thinking and locate relevant 
information from various sources to solve game 
problems. Finally, a post-test was carried out on both 
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groups of students to identify the teaching effect on 
increasing CT levels. 


Research Participants 


The research was undertaken involving two groups 
of students: 29 males and 30 females. Both groups had 
undergone the same intervention. The male and female 
groups were selected from different schools but with the 
same learning environment, namely, the daily school to 
avoid cross-contamination between the groups. 
Nevertheless, the instructors and teachers for male and 
female groups had a similar background in experience, 
qualifications, and socioeconomic status. 


Research Instrument 


The instrument used in the research was the CTS 
adapted from Korkmaz et al.’s (2017) CT scale. A five- 
point Likert scale, ranging from 1 (Never) to 5 (Always 
in CTS), was used to identify CT levels among the 
participants. The CTS evaluated and identified students’ 
skills degrees and revealed the CT levels. According to 
Korkmaz et al. (2017), CT skills comprise five 
subconstructs: algorithmic thinking, cooperativity, 
creativity, critical thinking, and problem-solving 
(Doleck, 2017; Korkmaz et al., 2015). Subsequently, CTS 
used in the research consisted of 29 items from these five 
subconstructs. There were six algorithmic thinking 
items, four cooperative items, eight creativity items, five 
critical thinking items, and six problem-solving items. 


Three different groups of people validated the CTS to 
determine the content validity and face validity. These 
people were professors in science and Information and 
Communications Technology (ICT), two expert English 
teachers, and fifteen lower secondary students. The 
researchers examined all the CTS items and decided on 
the convenient items. The two expert English teachers 
(with more than thirty years of English teaching 
experience) checked the CTS’s grammar. Statements that 
were challenging to understand and misleading items 
were controlled and corrected by the two expert English 
teachers. 


Simultaneously, the formed draft was examined by 
15 students whose comments were taken beforehand. 
They were interviewed to determine how difficult the 
items’ were to understand and their perception of each 
item. The interview ensured that the items were 
thoroughly —_ understood and = prevent = any 
misunderstanding of the sentence’s meaning. A pilot test 
was staged to identify and correct the instruments’ 
weaknesses and establish the reliability to achieve face 
validity. The reliability index for the CTS was computed 
using Cronbach’s alpha. Scores were coded, summed, 
and transformed to a scale from 1 (never) to 5 (always) 
for each parameter. The Cronbach’s alpha coefficients 
were 0.84 in the CTS reliability studies, suggesting that 
the items had a relatively high internal consistency. 


Cronbach’s alpha coefficients were calculated for 
each scale of the five subconstructs of CT: algorithmic 
thinking, cooperativity, creativity, critical thinking, and 
problem-solving to determine the reliability values. The 
values were found to be between 0.73 and 0.76. The 
items’ total correlation coefficients score were also 
individually estimated for each scale. The values were 
identified as: algorithmic thinking (between 0.47 and 
0.73), cooperativity (between 0.69 and 0.90), creativity 
(between 0.79 and 0.89), critical thinking (between 0.57 
and 0.78), and problem-solving (between 0.62 and 0.79). 


Intervention 


The intervention was implemented in two lessons for 
every week in three (3) months times. Each lesson lasted 
for 90 minutes. Both male and female groups underwent 
the same intervention with the same science teacher with 
years of teaching experience. Both groups of students 
were instructed with the STEAM integrated approach 
using Scratch. During the intervention, Scratch was used 
to deliver the electricity concept content knowledge and 
the way of using Scratch. After the lessons, every two 
students were grouped into a group. Then, students 
were required to design the electricity games, whereby 
students have the opportunity to apply the five 
subconstruct of CT during the design by integrating the 
STEAM element simultaneously. The game design 
combined works of art, formulas, electricity theories, 
and diagrams, but all of them served the same purpose 
in communicating the abstract concepts in electricity. 
After the intervention, the EAT instrument was applied 
to evaluate students’ CT and five CT subconstructs. 


Data Analysis Procedure 


Three tests were used in testing the research 
hypotheses: (a) paired sample t-test, (b) repeated 
ANOVA measure and analysis of covariance 
(ANCOVA), and (c) a one-way repeated measure 
MANOVA. A paired sample t-test was conducted to test 
the differences in CT levels for the two different groups. 
The ANOVA repeated measure and ANCOVA were 
undertaken to test group differences gradually on the CT 
score. One-way repeated measure MANOVA was 
conducted to test the differences in the five 
subconstructs of the CT. The MANOVA enables the test 
of hypotheses on the effect of the STEAM integrated 
approach on five subconstruct of CT simultaneously. 
Additionally, the MANOVA distinguishes whether 
statistical differences exist in the interaction between test 
time and the CT subconstructs. A pre-CT test was 
defined as a covariate to eliminate the original students’ 
CT level variation. 


Data Analysis 


Descriptive data were calculated for each dependent 
and independent variable groups. The descriptive 
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analysis included the number, mean, and standard 
deviation. Thus, two MANOVAs were completed. The 
first MANOVA determined the differences between 
males and females in achievement percentage of CT. In 
contrast, the second MANOVA was conducted to 
investigate possible CT percentage differences and 
among the five subconstructs of CT. 


The first step was to conduct descriptive statistics to 
determine the achievement percentages of CT and five 
CT subconstructs for male and female students. The 
descriptive analysis presented the number, mean 
percentages, and standard deviations for male and 
female students in answering the research questions. 
The second step was substantial and tested the null 
hypothesis and determined that no_ significant 
differences exist for the two groups of students. 
Therefore, the second step was focused on completing 
follow-up tests to explain the group differences in CT 
and the five CT subconstructs. A paired sample t-test, 
ANCOVA, MANOVA was used in this research to 
analyse the five subconstruct of CT. 


As with other statistical procedures, the research data 
proven satisfy certain assumptions for the work 
procedure, especially with the meaningful p values (p < 
.05). The data form a proper statistical random sample 
from an underlying population. The dependent 
variables have a normal distribution which was proved 
by Shapiro -Wilk test and Skewness and Kurtosis, on the 
pre-test and post-test on CTS and five subconstruct of 
CT, were normally distributed for both male and female 
students (p> 0.05), whereas Wilk’s Lambda = .70, F(5, 53) 
= 454, p < .05. Wilks’ Lambda test of statistical 
significance was applied. The probability value for 
gender effects was less than .05 (p < .05), then the effects 
were significant. A meaningful Pearson correlation 
pattern was observed among the dependent variables (p 
<.05), and Box’s M value of 21.78 with p = .18. Therefore, 
the covariance matrices between the groups were 
assumed to be equal in MANOVA. Finally, Levene’s test 
verified the equality of homogeneity of variance for each 
dependent variable (p > .05), and the correlation 
between the dependent variables is identical in all 
groups of observations. 


RESULTS 


The first research question addressed in this research 
was: 


Q1: What are the means score achievement of male 
and female students in CT, algorithmic thinking, 
cooperativity, creativity, critical thinking, and 
problem-solving skill? 

The descriptive data generated the mean and 
standard deviation of the pre-CT and post-CT tests for 
the male and female students. The mean and the 
standard deviation for the male students in the pre-CT 
test was 57.66 and 8.06, whereas post-CT values were 
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Table 1. Mean and standard deviation for the pre-computational thinking and post-computational thinking test of male 


and female students 


Gender Mean Standard deviation N 
Pre-CT Male 57.66 8.06 29 
Post-CT 92.90 6.53 
Pre-CT Female 56.80 7AA4 30 
Post-CT 94.77 6.01 


Table 2. Descriptive statistic for the pre-computational thinking and post-computational thinking test of five subconstructs 
of computational thinking: algorithmic thinking, cooperativity, creativity, critical thinking and problem solving 


Pre-test Post-test 
Gender M SD M SD 
Algorithmic thinking Male 9.59 2.13 17.41 3.10 
Female 10.93 2.74 19.17 2.72 
Total 11.27 2.53 18.31 3.02 
Cooperativity Male 9.83 2.38 10.24 2.23 
Female 7.67 2.04 12.23 2.32 
Total 8.73 2.45 11.25 2.47 
Creativity Male 12.72 3.73 25.93 2.34 
Female 10.93 2.78 23.87 2.80 
Total 11.81 3.38 24.88 2.77 
Critical thinking Male 8.79 1.84 15.10 3.42 
Female 9.90 2.06 16.83 2.69 
Total 9.36 2.02 15.98 3.17 
Problem-solving Male 10.28 2.42 16.90 3.56 
Female 8.93 2.49 18.57 1.94 
Total 9.59 2.53 17.75 2.95 


92.90 and 6.53. Comparably, the mean and standard 
deviation for the female students in the pre-CT test was 
56.80 and 7.44, while post-test CT values were 94.77 and 
6.01 (Refer to Table 1). The achievement data were 
segregated according to the five subconstructs of CT 
(Refer to Table 2). The descriptive analysis provided in- 
depth details on male and female students’ capabilities 
in CT and five subconstructs of CT. When evaluating 
students’ CT skills, no significant group differences are 
identified. Development of CT and five subconstruct of 
CT skills happens in the same way for both male and 
female group independently. The mean score for both 
male and female students of the pre-test is smaller than 
the post-test. Simultaneously, the mean score of the five 
subconstruct of CT kept increasing from pre-test to the 
post-test. 


In algorithmic thinking, the male showed 7.82, and 
the female showed an 8.24 increment in the means score. 
Females showed more increment than males in 
algorithmic thinking. On the other hand, in the 
cooperativity, males and females showed the 0.14 and 
4.56 increment, respectively, and the comparison 
showed that females improved in cooperative learning. 
Simultaneously, the increment can be observed in the 
creativity whereby males record the 13.21 and females 
12.94 increments in the mean score. Male students seem 
to enhance their creativity more than females. 


Meanwhile, male and female students displayed a 
6.31 and 6.93 increment in the critical thinking means to 
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score, which is almost the same. Maybe both groups of 
the students were exposed to the same environment in 
designing the problem-solving methods. Finally, for the 
last CT subconstruct- problem-solving, male and female 
students also present the means score increment. It was 
found that increment problem-solving skills among 
males and females is 6.62 and 9.64, respectively. To 
conclude, both males and females showed the increment 
in the five CT subconstruct, but the females displayed 
the total increment more than males. 


The second research question addressed in this study 
was: 


Q2: Do differences exist in the achievement of male 
and female students in CT, algorithmic thinking, 
cooperativity, creativity, critical thinking, and 
problem-solving skill? 


Differences in Computational Thinking among Male 
and Female Students 


A paired sample t-test was carried out to test the 
significant difference between CT’s pre-test and post-test 
scores for male and female students. The result of the 
paired t-test for male students was significant at t (28) = 
-21.25, p <. 05 (two-tailed), n2 = .94, since p < .05 (Refer 
to Table 3), and confirmed a significant difference 
between the pre-test and post-test for male students. 
Based on Cohen’s guidelines (1988) and Sawilowsky 
(2009), this effect size was huge, implying a significant 
increase in CT level for males from the pre-CT test (mean 
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Table 3. Paired samples t-test between the pre-computational thinking and post-computational thinking test of male and 


female students 


95% Confidence Interval 


of the Difference 


Pre-CTS ho, Std. Error 
Post-CTS Mean Std. Deviation Mean 
Male -35.24 8.93 1.66 
Female -37.97 9.68 1.77 


Sig. (Two- 
Lower Upper t df tailed) 
-38.64 -31.84 -21.25 28 00 
-41.48 -34.35 -21.49 29 00 


Table 4. Results of one-way ANCOVA for significant difference between male and female students’ computational thinking 


level at post-computational thinking test 


Source beams df Mean Square F Sig. sulsonely 
Squares Squared 

Corrected Model 54.464 2 27.23 .68 51 02 

Intercept 8952.48 1 8952.48 223.90 .00 .80 

Pre-test 2.89 1 2.89 07 79 00 

Gender 54.27 1 54.27 1.36 25 02 

Error 2239.16 56 39.99 

Total 521927.00 59 

Corrected Total 2293.63 58 


= 57.66, standard deviation = 8.06) to the post-test (mean 
= 92.90, standard deviation = 6.53). The rise in mean was 
35.24, with a 95% confidence level interval for 
differences between -38.64 (lower bound) to -31.84 
(upper bound), denoting a significant difference 
between the pre-CT and post-CT tests for male students. 


Contrastingly, the paired t-test results were found to 
be significant at t (29) = -21.49, p <. 05 (two-tailed), n2 = 
.94, since p < .05, confirming a significant difference 
(Refer to Table 3), confirmed a significant difference 
between the pre-test and post-test for female students. 
Based on Cohen’s guidelines (1988) and Sawilowsky 
(2009), this effect size was huge, implying a significant 
increase in CT level for females from the pre-CT test 
(mean = 56.80, standard deviation = 7.44) to the post-CT 
test (mean = 94.77, standard deviation = 6.01) was 
observed for female students. The rise in mean was 
37.97, with a 95% confidence level interval for 
differences between the means of -41.58 (lower bound) 
to -34.35 (upper bound). Therefore, the results exhibited 
a significant difference between the pre-CT and post-CT 
tests for female students. Conclusively, a significant 
difference was evident between pre-CT and post-CT 
tests for both males and females. Both groups of students 
gained a significant increase in the achievement of CT 
after the intervention. Based on the rise in mean, female 
students displayed higher increment in CT compared 
males. 


Further analysis between both genders in the post-CT 
test was undertaken as differences were identified in 
pre-CT and post-CT tests. The ANCOVA finding 
showed that no statistically significant difference were 
found between male and female students in CT values 
[F(1, 56) = 1.36, p > 0.05 (two-tailed), np2 (partial eta 
squared) = .02] (Refer to Table 4). In line with Cohen’s 
(1988) and Sawilowsky (2009) guidelines, the effect size 


(0.02) indicated a small magnitude effect (2.0%) of the 
variance in the dependent variable that was explainable 
by the independent variable (Cohen, 1988; Sawilowsky, 
2009). 


Using one covariant variable analysis technique, by 
controlling prior knowledge towards the linear 
relationship between previous CT, it shows significance 
score which is less than 0.05. If viewed the influence of 
STEAM integrated approach towards male and female 
students’ CT skill, it seems that significance score (group 
division) for STEAM education approach on CT skill is 
0.02. Since the score is less than 0.05, so it can be 
concluded that without the influence of prior 
knowledge, on the credibility level of 95%, there is an 
influence of STEAM integrated approach on towards CT 
skill. The effect of students’ prior knowledge and 
STEAM integrated approach towards students’ CT skill 
simultaneously can be seen from significance number on 
Corrected Model. It can be seen that a significant amount 
is 0.02. Since the significant number is less than 0.05, so 
it implies that simultaneously student's prior knowledge 
and type of learning used influence CT skill. 


The actual difference between mean scores of CT was 
also indicated by the posthoc analysis, where the mean 
and standard deviation for male students were 92.90 and 
6.53. The mean was 94.77, and the standard deviation 
was 6.01 for female students (Refer to Table 1) despite 
the statistical significance. Consequently, the STEAM 
integrated approach via Scratch effectively enhanced the 
CT level in male and female groups. Both groups 
showed positively similar results in increasing the CT 
level. 
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Differences in the Five Subconstructs of 
Computational Thinking among Male and Female 
Students 


The data in the Test of Between-Subject Effect were 
analysed to study how the dependent variables: 
algorithmic thinking, cooperativity, creativity, critical 
thinking, and problem-solving differ in both genders. 
According to the MANOVA findings, the interaction 
effect was statistically not significant for algorithmic 
thinking (Wilks’ Lambda = .90, F (5, 48) = 1.13; p > .05; 
partial n2 = .09), cooperativity (Wilks’ Lambda = .96, F 
(5, 48) = .35; p > .05; partial n2 = .17), creativity (Wilks’ 
Lambda = .94, F (5, 48) = .63; p > .05; partial n2 = .14), 
critical thinking (Wilks’ Lambda = .98, F (5, 48) = .16; p > 
05; partial n2 = .08) and problem-solving (Wilks’ 
Lambda = .93, F (5, 48) = .76; p > .05; partial n2 = .08) 
(Refer to Table 6). The between-subjects effects revealed 
no statistically significant difference in CTS among male 
and female students’ for the five subconstructs of CT (p 
> .05). 

In summary, both male and female students 
demonstrated a positive tendency to increase CT level 
and the five CT subconstructs. All the five subconstructs 
of CT increased simultaneously and proved that both 
genders have equality in gaining CT skills and learning 
electricity concepts. Female and male students displayed 
the potential in applying the STEAM element in 
enhancing the CT skills when studying the electricity 
concepts. 


DISCUSSION 


The current research analyzed male and female 
students’ CT skills in designing electricity concepts 
games, emphasizing the STEAM integrated approach’s 
impact on different gender student groups. The research 
results provide sufficient evidence from evaluation CTS 
instruments administered before and after the 
intervention, thus offering a clear idea of how CT skills 
develop as students’ designing progresses. The research 
indicates that the STEAM integrated approach via 
Scratch had successfully supported both male and 
female students’ five subconstruct of CT skills. Both 
male and female students showed increased CT skills 
and could apply all five subconstruct of CT during the 
game’s development. 


In answering Research Question 1, the research 
finding shows that the intervention positively increased 
both the male and female students’ CT skills and five CT 
subconstructs (Tables 1 and 2). Table 1 illustrates a 
change in students’ CT and the other five subcontract CT 
skills patterns. In Table 1, before treatment using the 
STEAM integrated approach method, male students are 
still at an average level of 57.66, and female students are 
still at an average level of 56.80 for the CT application 
level. Before the intervention, both genders of students 
were still not familiar with using visual learning media 
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with Scratch. They found it difficult to express the 
understanding of electricity through the art or was still 
elementary level in algorithmic thinking, cooperative, 
creative, critical thinking, and problem-solving patterns. 
In the pre-test, both gender students faced difficulty 
understanding and applying the CT skills, which was 
proven by the low means scores. The concepts of 
application of CT skills in solving problems appear blur 
among most of the students. The students had no 
confidence in applying CT to solve the problems during 
the lessons. Consequently, the high value of the standard 
deviation for the male and female students shows the 
vast difference among the students on the CT skills 
application. 


Nevertheless, both male and female students scored 
high in the post-CT test after the intervention using the 
STEAM integrated approach method. The number of 
male and female students who showed the CT skills 
capability in games designing on electricity concepts 
increased. Both male and female students independently 
develop the same CT skills at the end of their 
intervention. The data showed a significant increment in 
the mean score of post-CT results compared with the low 
mean score in the pre-CT test. Students underwent an 
increase in their CT skills patterns by an average mean 
score of 92.90 and 94.77, respectively, on male and female 
students, where there is an increase in the difference of 
35.24 points at male students and 37.97 points at female 
students. This proves that the STEAM integrated 
approach method had positively impacted the ability to 
apply CT, namely producing interactive games in 
explaining the electricity concepts. Meanwhile, both 
genders of students also exhibit enormous progress in 
mastering the five CT subconstruct in problem-solving. 


Table 2 shows that the five subconstruct of CT 
improvement among the male and female students in 
the post-CT test is higher than the pre-CT test. The mean 
difference test results indicate a significant difference in 
five subconstructs of CT skills before and after the 
intervention. The big improvement of students’ five 
subconstructs of CT skills in both gender groups can be 
explained by the STEAM integrated approach and 
learning process on each group during learning. The 
most remarkable improvement was achieved in the 
subconstruct creativity, whereby males record the 13.21 
and females record the 12.94 increments in the mean 
score. The lowest increasement was achieved in the 
subconstruct cooperativity. The ability to apply CT was 
tested in designing games with Scratch. The research 
finding indicated that the STEAM integrated approach 
via Scratch successfully increased five subconstruct of 
CT (based on Table 2), which also parallel with Bell and 
Bell (2018) and Psycharis (2018) finding. So, the STEAM 
integrated approach to learning electricity concepts 
positively impacts the increase of students’ CT and five 
subconstructs of CT thinking skills. The increase of 
students’ CT and five subconstruct of CT skills can be 


identified from each indicator given when pre-test and 
post-test commonly increase in both gender groups. 


Both male and female groups showed an increment 
in post-CT and the capability to apply five CT 
subconstruct in solving problems when designing 
games. The wide application of these five CT 
subconstructs, namely algorithmic thinking, 
cooperativity, creativity, critical thinking, and problem- 
solving (Korkmaz et al., 2017) among males and females, 
were observed during the design of the games. Students 
developed the information, tested the solutions, 
evaluated existing CT to create new games, and 
expanded current CT. The CT focused on students’ ways 
of solving problems rather than working like a machine 
in this research. The innovative use of CT sets deepened 
science’s content learning, especially electricity concepts, 
as agreed by Weintrop et al. (2016). The CT being 
nurtured in this aesthetics-based research during the 
construction of knowledge based on constructionism 
theory. From the moment students get involved in 
comprehending the problems by thinking, analyzing, 
and diagnosing the types of issues in designing the 
games, they are already involved in constructionism 
learning with art. Students started learning in a 
constructionist way when exploring surroundings and 
construct interpretation with problem-solving through 
games designing in aesthetics environment. 


These five subconstruct were significantly displayed 
among the students during the games designing process. 
For the first subconstruct, algorithmic thinking can break 
down a problem logically and methodically compose a 
suitable algorithm by understanding, applying, 
assessing, and producing the algorithms (Korkmaz et al., 
2017). During the games designing process, the students 
focused on using this algorithmic thinking to draft out 
every step and movement of the characters in the games 
to have a smooth flow and implement strategies to solve 
problems. Students who have mastered algorithmic 
thinking showed the ability to analyze the gained data 
on electricity concepts, make an affirmation, and draw 
conclusions based on their analysis findings (Weintrop 
et al., 2016). The algorithmic improvement thinking and 
problem-solving through the element of science in 
STEAM integrated approach consisted of students’ 
ability to explain the electricity concepts and interpret 
data, numbers, and words scientifically and orderly with 
algorithmic thinking to solve the content knowledge 
understanding problems. The application of the 
scientific concept in game design was closely related to 
the indicator of application algorithmic thinking, 
problem-solving through the STEAM integrated 
approach that applies the principles of science, 
technology and develops solutions to achieve the target 
in designing the games. 

For the second CT subconstruct, cooperativity has 
gained popularity among the learning method to 
contribute to academic success, share knowledge, and 
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construct social relationships (Korkmaz et al., 2017). In 
this research, cooperative learning — significantly 
influences students to work collaboratively to identify 
the required skills in solving a problem. Students 
showed the capability to analyze a problem they faced 
from multiple perspectives or produce multiple 
solutions through information sharing during 
cooperative learning after the intervention. Cooperative 
learning engaged students in self-directed learning in 
STEAM integrated approach activities lead and 
enhances students’ communication competency and 
motivation to learn. Besides that, the other CT 
subconstruct, like creativity, critical thinking, and 
problem-solving, were also widely applied during game 
designing. When students think critically, they also 
think deeply; they understand the facts, but they take the 
extra step of going beyond the facts to do something 
with them. 


Visualization is one of the most popular among the 
different modes of aesthetic representations of scientific 
knowledge (Hammer, 2014). It was proven through lots 
of researches to explore the role of images in science 
from different perspectives (Adelmann et al., 2009; 
Borrelli & Grieser, 2017; Frappier et al., 2013; Halpern, 
2014). The visualization represents the essence of all 
scientific activity. It can be concluded that scientists use 
an aesthetic way (visualization way) to bring 
understanding in the specimens, genetic sequence, or an 
undefined protein (Borrelli & Grieser, 2017). The product 
of scientific or artistic work represents how the problems 
were solved. Concurrently, abstract concepts learning 
appeared to be more meaningful and engaging. The 
complex of decisions, activities, and processes that 
comprise an aesthetic can be considered the bridge 
linking the abstract world we sense with the ordered 
world that we articulate (Hammer, 2014). Hence, the 
STEAM approach in learning does not only help teach 
science concepts but also enables students to think and 
work with art and science simultaneously, inspiring 
students to become more different and become creative 
and critical thinkers across disciplines. 


The activity of games designing that applies 
electricity concepts requires students to be able to think 
critically and creatively in overcoming any obstacles 
found in the game-making process. In other words, there 
were no more memorization and recall of factual 
information during the learning process. Students were 
exposed to the opportunity required to make the well- 
reasoned evaluative aesthetics judgment. Students 
analyzed, evaluated, or make judgments during critical 
thinking problem-solving and reached the final decision. 
Students’ solving problems reflected that students had 
manipulated the skills in putting theory into practice 
when directly involved in generating, analyzing, and 
evaluating the best solutions. As a principle for putting 
theory into practice in learning and its approach, 
Papert’s constructionism serves as the guiding principle 
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in the future for curriculum design, materials 
development, and classroom practice. The capability of 
employing the CT and five subconstruct of CT works as 
good indicators of understanding the effectiveness of 
using STEAM integrated approach to develop solutions 
to achieve the learning objectives. The CT application 
enables the students to propose creative, algorithmic 
solutions and alternatives and decide the suitable 
solution for the problems. Hence, creating and designing 
the games that train students’ CT is carried out along the 
intervention. Therefore, students need creativity and 
critical thinking to develop solutions to achieve goals. 


In answering Research Question 2, the research 
finding proved no significant difference among the male 
and female group students in CT with the STEAM 
integrated approach (Table 3 and 4). Simultaneously, no 
significant differences were identified in the linear 
combination of the mean for the post-test mean score in 
CT among the male and female students who followed 
the STEAM integrated approach via Scratch. All five 
subconstructs of CT showed a similar positive effect for 
both groups of students. Both groups of students 
managed to show a significant increment in CT and the 
five subconstructs of CT. Both genders also showed a 
statistically significant relationship with the combined 
dependent variables. Besides, the five subconstructs of 
CT were analysed with the probability value for gender 
at less than .05 (Wilks’ Lambda = .63, F (5, 53) = 6.13; p< 
.05; partial n2 = .37). The students were found to have 
acquired the CT skills and enhanced the application of 
CT skills and five subconstruct of CT in understanding 
the concept of electricity, such as calculating the electric 
current, resistance, and the construction of the electric 
circuit. 


All the five CT subconstruct showed the favourable 
linear combination and interrelated under CT in 
enhancing both males and females. In other words, all 
these subconstruct algorithmic thinking, cooperativity, 
creativity, critical thinking, and problem-solving show 
equal importance. The linear combination of the mean 
for post-test mean score of construct algorithmic 
thinking, cooperativity, creativity, critical thinking, and 
problem-solving in CT positively impacts both males 
and females learning electricity concepts. No gender is 
left behind in learning and has equal opportunity in the 
application of CT skills. The five CT subconstruct 
functions well in improving the total CT skills by being 
implemented together to solve the problem during 
games designing. The research finding shows no 
significant difference between all these five CT 
subconstruct among males and females on the post-CT 
(Table 4). The research also showed that gender had a 
statistically significant relationship with CI’s five 
subconstructs. Both genders showed the capability of 
applying all the CT skills together in problem-solving 
during learning. 


14 / 19 


Moving on to Table 4, in evaluating students’ CT 
skills, no between-group differences are identified. It is 
proven by analysis by using the ANCOVA test. The 
results showed a difference of influence that is 
convincing between prior knowledge and the student’s 
CT skill. In answering the second research question, the 
research finding showed that the intervention had a 
similar positive effect in increasing both male and female 
CT and all the five subconstructs of CT (Table 3). The 
results of the hypothesis analysis test in Table 3 show 
that: t-count for male students is 21.25, and the t-count 
for female students is 21.49 and Sig. (2-tailed) indicates 
that Sig. (2-tailed) count <0.05. Explained a change in 
both gender students’ CT abilities using the STEAM 
integrated approach method. This analysis explains that 
the learning method uses the STEAM integrated 
approach method, and students are invited to continue 
improving their CT. 

It can be seen from the increase in the average CT 
learning outcomes before and after with an increase in 
the difference of 35.24 points at male students and 37.97 
points at female students from the average before using 
the STEAM integrated approach method in learning. The 
increase in the average learning outcomes shows that the 
STEAM integrated approach method is reliable because 
each student can develop CT in testing or application of 
knowledge. In this case, the making of games based on 
technology and images and language (art) in 
mathematical analysis, in the form of a scale or a pause 
between one animated image slide and language with 
another so that it is easy to understand the delivery of 
the learning. The analysis of hypothesis testing using the 
t-test shows that the ability to think CT on games 
designing assignments has increased by 21.25 and 21.49, 
by the involvement of students directly start from the 
preliminary stage (needs analysis, use of appropriate 
media methods), the stage of making learning games, the 
product testing stage until the final stage of product 
strengthening. 


Although males and females reach the same CT skills 
level (ANCOVA in Table 4), there is, however, a 
significant difference between cooperativity and 
problem-solving for the female, indicating that the 
female does learn more in the cooperative learning with 
peers and exchange the problem-solving method in 
order to find the best solution for the problems. This 
difference is also reflected in the male post-test, but just 
the difference is not so apparent as females do (Table 3). 
Students gave feedback through comments on projects, 
worked together on collaborative projects, remixed one 
project with another, crowd-sourced artwork for their 
projects, and designed games to share their new 
knowledge. The female students’ ability to acquire 
problem-solving skills in connecting with daily life and 
utilizing new technologies is valuable to meet the 21st- 
century requirements (Lin et al., 2021). STEAM refers to 
the intersection of sciences and arts that incorporates 


skills, including languages and liberal arts, such as 
sociology, philosophy, history (Yakman, 2010), or 
specific artistic disciplines such as design, creative 
writing, or visual and performing arts (Iglesias et al., 
2018). 


The potential of art in reducing gender inequality in 
STEAM is quite tangible (OECD, 2018). Connecting art 
to science makes learning more effective and innovative 
(Liliawati et al., 2018) and supports equal opportunities 
among males and females. More female students 
showed the capability to use CT to solve electricity 
concept game designing problems after the intervention. 
Ruiz-Mallén et al. (2017) also agreed that the 
involvement in the artistic experience enables the retain 
more females in science learning. Hence, the STEAM 
integrated approach enables the transformation of the 
theoretical knowledge into practice and creating an 
environment for the design and product development as 
agreed by Tunc and Bagceci (2021), as well as nurture the 
problem-solving skills in order to prepare students in 
placing the thinking and exploration in daily life 
(Gunawan & Shieh, 2020). Students’ experience in the 
calculation (Mathematics) is also being enhanced when 
students learn about the electric current in the circuit. 
Eventually, students improved the electricity concepts 
content knowledge and used general thinking to solve a 
problem mathematically. 


The aesthetic form of learning through the art 
experience occurred at its best when students were 
encouraged to understand their surrounding world 
independently by aesthetic represent all the electricity 
concepts via Scratch. When students are asked to 
provide evidence of CT skills, they appear to perform 
very well in applying all the five subconstruct of CT in 
designing the games on electricity concepts. Students 
thoroughly express their five CT subconstructs required 
to describe a generalized problem solution. The STEAM 
integrated approach via Scratch provided authentic 
learning when developing the actual product (Sahin et 
al., 2014). In this research, the actual products, designing 
games which contained one discipline and integrated 
with other disciplines, like science, technology, 
engineering, art, and mathematics. The STEAM 
integrated approach opened up a new way of seeing, 
thinking, and learning (Psycharis, 2018) with the 
aesthetics art experience. Students had _ learning 
opportunities to transcend five different disciplines and 
enrich their learning (Hetland, 2013; Psycharis, 2018). 
Besides, students strengthened their disciplinary 
knowledge across another domain and got the 
opportunity to explore and connect art, science, and 
others (Henriksen, 2014). Through STEAM’s learning to 
train the talents to face the problems of the 21st century 
(Boy, 2013; Liliawati et al., 2018; Piro, 2010). 

In short, in this research, the applied learning 
strategies influence the increase of CT and the five 
subconstructs of CT. The emphasize on the aesthetic 
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value of art in STEAM integrated approach via Scratch 
made the male and female students learn and work the 
STEAM elements, inspiring them to be more creative 
and innovative thinkers across disciplines. They 
indirectly grew up as creative thinkers when students 
create characters and storylines in their games. They 
used their imaginations to explore new ideas and 
directions, parallel with constructionist theory, whereby 
learners construct new knowledge by learning. 


CONCLUSION 


Based on the analysis and discussion results, STEAM 
integrated approach learning through the games 
designing project on electricity concepts that has been 
implemented has a significant effect on the improvement 
of students’ CT skills and five subconstruct of CT. Both 
male and female students showed equal ability in 
applying CT and five subconstruct of CT after the 
STEAM integrated approach intervention. Both genders 
of students showed the mastering skills on the electricity 
concepts through the aesthetics experience through 
game’s development after the invention. Indirectly, the 
art experience in learning promoted gender equality and 
proved that both males and females equally showed CT 
skills. Through the research finding, data had proven 
that art integration in the STEAM integrated approach 
posed a significant positive impact and influence in 
learning the science concepts, CT skills, and five 
subconstruct of CT. Nevertheless, the limitation of the 
current research was focused on applying the STEAM 
integrated approach in learning on a specific science 
topic, rather than on the close study across different and 
variety theme of science topics. This means that 
researchers currently know relatively little about the 
STEAM integrated approach on other different science 
topics. Hence, future research could be conducted to 
serve the real purpose of STEAM implementation in the 
different theme of science topics, then examine how 
successful the STEAM integrated approach is in helping 
students’ in science learning with art integration. 
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